XR Flight Debriefing

Adding New Dimensions to Pilot Training

To no surprise, the US Air Force takes pilot training very seriously. After every flight, all involved pilots meet together in a private room to debrief each maneuver made. There are plenty of high-tech solutions that make the US Air Force as strong as they are, but one area that they addressed could use a revamp was debriefing. They are limited to very 2D methods of communicating a 3D event.

Together with a team of airmen at Luke Air Force Base, I created a live reenactment of a flight mission in 3D using Unity. The experience connected two users wearing Hololens 2 mixed reality headsets to a shared virtual environment. The most satisfying features included realistic flight path animations, an accurate topographic map, and UI controls to pause or pause/play/change the speed.